Data Quality Sensitivity Analysis on Aggregate Indicators
نویسندگان
چکیده
Decision making activities stress data and information quality requirements. The quality of data sources is frequently very poor, therefore a cleansing process is required before using such data for decision making processes. When alternative (and more trusted) data sources are not available data can be cleansed only using business rules derived from domain knowledge. Business rules focus on fixing inconsistencies, but an inconsistency can be cleansed in different ways (i.e. the correction can be not deterministic), therefore the choice on how to cleanse data can (even strongly) affect the aggregate values computed for decision making purposes. The paper proposes a methodology exploiting Finite State Systems to quantitatively estimate how computed variables and indicators might be affected by the uncertainty related to low data quality, independently from the data cleansing methodology used. The methodology has been implemented and tested on a real case scenario providing effective results.
منابع مشابه
Institutional Requirements for Enhancing Financial Stability in Iran
The conditions in which the financial system can continuously provide the necessary services for the proper functioning of the economy is called “financial stability”. In this study, using global experience and Iranian data from 1990 to 2016, an aggregate index of financial stability for Iran has been constructed under the four dimensions of "deposit taker institutions", "macroeconomics", "for...
متن کاملEffects of Drying Temperature and Aggregate Shape on the Concrete Compressive Strength: Experiments and Data Mining Techniques
The main purpose of this paper is to assess the impact of the geometry and size of the aggregate, as well as the drying temperature on the compressive strength of the ordinary concrete. To this end, two aggregates with sharp and round corners were prepared in three different aggregate sizes. After preparing concrete samples, the drying operations were carried out in the vicinity of room tempera...
متن کاملUsing Change Point Detection for Monitoring the Quality of Aggregate Data
Introduction Data consisting of counts or indicators aggregated from multiple sources pose particular problems for data quality monitoring when the users of the aggregate data are blind to the individual sources. This arises when agencies wish to share data but for privacy or contractual reasons are only able to share data at an aggregate level. If the aggregators of the data are unable to guar...
متن کاملAssociation between quality management and performance indicators in Dutch diabetes care groups: a cross-sectional study
OBJECTIVES To enhance the quality of diabetes care in the Netherlands, so-called care groups with three to 250 general practitioners emerged to organise and coordinate diabetes care. This introduced a new quality management level in addition to the quality management of separate general practices. We hypothesised that this new level of quality management might be associated with the aggregate p...
متن کاملStability and sensitivity of nursing home quality indicators.
THE issues of stability and sensitivity of indicators to actually detect differences in quality of care in nursing facilities are not only of concern to researchers, but also to public policy makers, who are reporting indicators to providers and now to consumers. Our research team at the University of Missouri-Columbia recently completed a study of 92 randomly selected nursing homes with a rang...
متن کامل